基于MapReduce计算模型的气象资料处理调优试验   总被引：1，自引：1，他引：0       下载免费PDF全文

杨润芝  沈文海  肖卫青  胡开喜  杨昕  王颖  田伟 《应用气象学报》2014,25(5):618-628

云计算技术使用分布式的计算技术实现了并行计算的计算能力和计算效率,解决了单机服务器计算能力低的问题。基于长序列历史资料所计算得出的气候标准值对于气象领域实时业务、准实时业务及科学研究中均具有重要的意义。由于长序列历史资料数据量大、运算逻辑较复杂,在传统单节点计算平台上进行整编计算耗时非常长。该文基于Hadoop分布式计算框架搭建了集群模式的云计算平台,以长序列历史资料作为源数据,基于MapReduce计算模型实现了部分整编算法,提高计算时效。同时,由于数据源本身具有文件个数多、单个文件小等特点,对数据源存储形式及数据文件大小进行改造,分别利用SequenceFile方式及文本文件合并方式对同一种场景进行计算时效对比测试,分别测试了10个文件合并、100个文件合并两种情况,使时效性得到了更大程度的提升。  相似文献   

大量气象数据小文件自适应优化传输          下载免费PDF全文

陆颖华  马廷淮  曹浩  李德泉 《应用气象学报》2014,25(5):629-637

为满足气象实时资料传输中大量气象数据小文件的高时效传输需求,对其中的数据传输服务进行优化,提出一种基于实时网络状况的自适应数据传输优化方法。该方法采用优化网络传输协议并使用文件压缩技术,通过获取网络传输线路上的实时参数,实时调整压缩参数和网络传输参数以优化传输性能。在自适应压缩时,通过试验分析和归纳,确立了气象数据小文件标准为文件小于50 KB;根据网络实时状况,设计了基于实时网络状况自适应调整压缩等级的算法。在自适应传输参数调优中,研究了TCP缓冲区大小和TCP并发连接数在GridFTP协议中的重要性,针对实时网络状况,分别设计了自适应调整TCP缓冲区大小和TCP并发连接数的算法,算法提升传输性能65%。对以上提出各自适应参数调整算法进行试验验证表明,融合压缩和网络传输的自适应调优方法能显著提升气象小数据文件的传输性能近500倍。  相似文献   

Tropospheric Wet Refractivity Tomography Based on the BeiDou Satellite System简     

WANG Xiaoying  WANG Xianliang  DAI Ziqiang  KE Fuyang  CAO Yunchang  WANG Feifei  and SONG Lianchun 《大气科学进展》2014,31(2):355-362

This paper presents a novel approach for assessing the precision of the wet refractivity field using BDS （BeiDou navigation satellite system） simulations only,GPS,and BDS＋GPS for the Shenzhen and Hongkong GNSS network.The simulations are carried out by adding artificial noise to a real observation dataset.Instead of using the δ and σ parameters computed from slant wet delay,as in previous studies,we employ the Bias and RMS parameters,computed from the tomography results of total voxels,in order to obtain a more direct and comprehensive evaluation of the precision of the refractivity field determination.The results show that：（1） the precision of tropospheric wet refractivity estimated using BDS alone （only 9 satellites used） is basically comparable to that of GPS; （2） BDS＋GPS （as of current operation） may not be able to significantly improve the data＇s spatial density for the application of refractivity tomography; and （3） any slight increase in the precision of refractivity tomography,particularly in the lower atmosphere,bears great significance for any applications dependent on the Chinese operational meteorological service.  相似文献   

An Overview of BCC Climate System Model Development and Application for Climate Change Studies          下载免费PDF全文

WU Tongwen  SONG Lianchun  LI Weiping  WANG Zaizhi  ZHANG Hu  XIN Xiaoge  ZHANG Yanwu  ZHANG Li  LI Jianglong  WU Fanghu  LIU Yiming  ZHANG Fang  SHI Xueli  CHU Min  ZHANG Jie  FANG Yongjie  WANG Fang  LU Yixiong  LIU Xiangwen  WEI Min  LIU Qianxi  ZHOU Wenyan  DONG Min  ZHAO Qigeng  JI Jinjun  Laurent LI  ZHOU Mingyu 《Acta Meteorologica Sinica》2014,28(1):34-56

This paper reviews recent progress in the development of the Beijing Climate Center Climate System Model(BCC-CSM) and its four component models(atmosphere,land surface,ocean,and sea ice).Two recent versions are described:BCC-CSM1.1 with coarse resolution(approximately 2.8125°×2.8125°) and BCC-CSM1.1(m) with moderate resolution(approximately 1.125°×1.125°).Both versions are fully coupled climate-carbon cycle models that simulate the global terrestrial and oceanic carbon cycles and include dynamic vegetation.Both models well simulate the concentration and temporal evolution of atmospheric CO_2 during the 20th century with anthropogenic CO2 emissions prescribed.Simulations using these two versions of the BCC-CSM model have been contributed to the Coupled Model Intercomparison Project phase five(CMIP5) in support of the Intergovernmental Panel on Climate Change(IPCC) Fifth Assessment Report(AR5).These simulations are available for use by both national and international communities for investigating global climate change and for future climate projections.Simulations of the 20th century climate using BCC-CSMl.l and BCC-CSMl.l(m) are presented and validated,with particular focus on the spatial pattern and seasonal evolution of precipitation and surface air temperature on global and continental scales.Simulations of climate during the last millennium and projections of climate change during the next century are also presented and discussed.Both BCC-CSMl.l and BCC-CSMl.l(m) perform well when compared with other CMIP5 models.Preliminary analyses indicate that the higher resolution in BCC-CSM1.1(m) improves the simulation of mean climate relative to BCC-CSMl.l,particularly on regional scales.  相似文献   

The day-to-day monitoring of the 2011 severe drought in China   总被引：1，自引：0，他引：1  

Er Lu  Wenyue Cai  Zhihong Jiang  Qiang Zhang  Cunjie Zhang  R. Wayne Higgins  Michael S. Halpert 《Climate Dynamics》2014,43(1-2):1-9

Dry/wet condition has a large interannual variability. Decision-makers need to know the onset, duration, and intensity of drought, and require droughts be monitored at a daily to weekly scale. However, previous tools cannot monitor drought well at this short timescale. The Palmer Drought Severity Index has been found dissatisfactory in monitoring because of its complexity and numerous limitations. The Standardized Precipitation Index (SPI) always asks for a timescale, and precipitation is averaged over the period of the scale. Because of this, the SPI cannot be used for short scales, e.g., several days, and what it tells is the overall drought situation of the period. The weighted average of precipitation (WAP) developed by Lu (Geophys Res Lett 36:L12707, 2009) overcomes the deficiency of the SPI; it does not require a timescale, and can provide the drought (and flood) extent of each day. Therefore, the WAP can monitor drought at scales from daily to weekly, monthly, and any longer scale, and is really “flexible and versatile for all timescales”. In this study, the standardized WAP (SWAP) is used to monitor the 2011 drought over China. Drought swept the country during the year from north to south and from east to west. In spring, a once-in-a-fifty-year drought occurred over the Yangtze River basin and the southern region, causing serious shortage of drinking water for people and livestock, as well as tremendous losses in agriculture and the shipping industry. Results show that the SWAP, with its monthly mean plots, can well reproduce the seasonal shift of the 2011 drought across the country. The animation of daily plots demonstrates that the SWAP would have been able to monitor the day-to-day variation of the spring drought around the Yangtze River basin. It can provide the details of the drought, such as when the drought emerged over the region, how long it maintained there (though drought area may move back and forth with extension and contraction of the area), and when the drought relieved over the basin.  相似文献   

Present and projected degree days in China from observation,reanalysis and simulations   总被引：1，自引：0，他引：1  

Qinglong You  Klaus Fraedrich  Frank Sielmann  Jinzhong Min  Shichang Kang  Zhenming Ji  Xiuhua Zhu  Guoyu Ren 《Climate Dynamics》2014,43(5-6):1449-1462

Degree days are usually defined as the accumulated daily mean temperature varying with the base temperature, and are one of the most important indicators of climate changes. In this study, the present-day and projected changes of four degree days indices from daily mean surface air temperature output simulated by Max Planck Institute, Earth Systems Model of low resolution (MPI-ESM-LR) model are evaluated with the high resolution gridded-observation dataset and two modern reanalyses in China. During 1979–2005, the heating degree days (HDD) and the numbers of HDD (NHDD) have decreased for observation, reanalyses (ERA-Interim and NCEP/NCAR) and model simulations (historical and decadal experiments), consistent with the increasing cooling degree days (CDD) and the numbers of CDD (NCDD). These changes reflect the general warming in China during the past decades. In most cases, ERA-Interim is closer to observation than NCEP/NCAR and model simulations. There are discrepancies between observation, reanalyses and model simulations in the spatial patterns and regional means. The decadal hindcast/forecast simulation performance of MPI-ESM-LR produce warmer than the observed mean temperature in China during the entire period, and the hindcasts forecast a trend lower than the observed. Under different representative concentration pathway (RCP) emissions scenarios, HDD and NHDD show significant decreases, and CDD and NCDD consistently increase during 2006–2100 under RCP8.5, RCP4.5 and RCP2.6, especially before the mid-21 century. More pronounced changes occur under RCP8.5, which is associated with a high rate of radiative forcing. The 20th century runs reflect the sensitivity to the initial conditions, and the uncertainties in terms of the inter-ensemble are small, whereas the long-term trend is well represented with no differences among ensembles.  相似文献   

2021年夏季中国大陆涝渍灾害时空分布分析     

李梦倩  房世波  朱永超  武英洁  曹云  卓文  俄有浩 《遥感学报》2022,26(9):1886-1894

涝渍害是中国除干旱以外对农作物影响最严重的气象灾害,涝渍害的发生和发展对人民的生命和财产安全以及农作物的生长发育产生巨大的影响。2021年7月至8月间,中国北方多地降水达到历史观测极值,而相应时期地面的涝渍害发生和发展状况及其时空特征并未得到有效研究。因此,本研究首先利用中国大陆土壤水分站点日数据和被动微波遥感卫星SMAP反演土壤水分日产品获取中国高精度表层土壤湿度数据（0—10 cm）;随后,结合田间持水量数据计算土壤表层相对含水量。在此基础上,以连续10 d土壤相对含水量大于等于90%为标准,分析中国大陆2021年7月1日—8月25日的涝渍害时空分布情况。结果表明：（1）融合后的土壤水分产品较原始的SMAP微波土壤水分产品精度具有明显的提高;（2）中国东北地区水稻田种植区的土壤相对含水量大于等于90%的最长持续天数均为56 d,土壤的水分长期处于饱和状态,说明了本文方法能够较为准确的反应出土壤涝渍害的情况;（3）中国东北及华北地区受灾较为严重,其中黑龙江的西部和河北、河南、山东发生的涝渍面积最大。中国大陆耕地部分受涝渍灾害区域占到总耕地面积的1/2左右,重灾区面积为1.940×10⁵ km²;（4）黑龙江的西部及河北、河南、山东等地较往年降水偏多,这与涝渍害受灾区基本吻合。  相似文献   

中国大陆降水时空变异规律——I.气候学特征   总被引：2，自引：0，他引：2       下载免费PDF全文

任国玉  战云健  任玉玉  陈峪  王涛  柳艳菊  孙秀宝 《水科学进展》2015,26(3):299-310

为系统了解大尺度降水气候特征,利用2 300多个国家级气象站逐日观测资料,分析了中国大陆1956—2013年多年平均降水的空间分布和季节性变化规律。主要新认识有:① 暴雨量、暴雨日数和暴雨强度最高的站点在华南沿海,而小雨量、小雨日数最多的站点主要在江南内陆山区、丘陵;东部季风区山地、丘陵多出现低强度降水,平原和沿海易出现高强度降水;② 四季降水量均由西北内陆向东南沿海递增,南方秋季降水量明显小于春季,但华西和江南沿海秋季降水量较多,冬季降水在东南丘陵出现高值中心;③ 珠江和东南诸河流域降水量年内存在2个峰值,其中珠江流域有6月主峰值和8月次峰值,东南诸河流域主峰在6月中下旬,次峰在8月末,长江流域总体表现为单峰型,出现在6月下旬和7月初,西南诸河流域和北方所有流域降水均表现为夏季单峰型;④ 南方各大河流域从2月末到6月中下旬陆续进入雨季,北方各大河流域进入雨季时间集中在6月末、7月初;南、北方雨季结束时间比雨季开始时间集中,从南到北进入雨季时间持续120 d以上,而从北到南退出雨季时间则仅持续不到45 d;⑤ 丰雨期的持续时间,珠江流域从5月初到9月上旬后期,东南诸河从5月上旬到7月上旬,8月末到9月初再度短暂出现,长江流域从6月中下旬到7月中旬,西南诸河从7月中旬到 8月下旬,淮河流域从7月上旬至7月底、8月初,辽河流域在8月初出现极短丰雨期;⑥ 降水年际变异性最高的站点在青藏高原西南、塔里木盆地、阿拉善高原、华北平原北部和汾河谷地,海河流域年降水具有最大的变异系数。  相似文献   

Study of the climatological behaviors of Euro-Atlantic and West Asia blockings in the period of 1959–2018     

《Dynamics of Atmospheres and Oceans》2020

In this study, comparison of blocking climatological behaviors is presented for the two periods of 1959–1988 and 1989–2018 in a part of the Northern Hemisphere including the Atlantic Ocean, Europe and West Asia regions. Blocking events were detected using a modified blocking index that is based on vertically integrated potential vorticity. By applying this index, the characteristics of detected blocking events such as frequency, duration, intensity and area were determined and compared for both the periods.According to the results, on average, 16 and 15 blocking events per year were identified in the first and second periods, respectively. The trend analysis shows that the number of blocking events in the period 1959–1988 was significantly decreased, while it was slightly increased in the period 1989–2018. Blocking activity was most prevalent from the eastern Atlantic through Europe to West Asia, but this longitude band exhibits a relatively eastward shift in the second period. In addition, the seasonal distributions are similar to those found in previous studies with the higher occurrence of blocking events during winter and autumn seasons and the lowest frequency in summer, as well as long-lasting events and greater intensity and extension in winter than the summer time, especially in the second period. These seasonal variations of blocking frequency may be due to synoptic scale eddies and planetary waves which are more active and stronger in the colder seasons than the other seasons. On the other hand, a comparison between the two periods shows that the blocking events tend to be more frequent over West Asia especially during summer in recent years. Although discrepancies between the two periods are not significant, they could be partly due to the impacts of climate change in recent decades.  相似文献   

中国热带海-气相互作用与ENSO动力学及预测研究进展     

任宏利  郑飞  罗京佳  王润  刘明竑  张文君  周天军  周广庆 《气象学报》2020,78(3):351-369

国际上针对海洋-大气系统的观测、理论和模拟方面已经开展了广泛而深入的研究,为短期气候预测水平的不断提升奠定了坚实基础,这其中中国学者做出了许多重要贡献。文中简要回顾了中国学者70年来在热带海-气相互作用与ENSO动力学及预测方面的研究进展。其中,热带海-气相互作用部分主要涉及4个方面的内容:热带太平洋气候特征与ENSO现象、热带印度洋海温主要模态及其与太平洋相互作用、热带大西洋海温主要模态及与海盆的相互作用、中高纬度海-气系统对ENSO的影响;ENSO动力学包括7个方面的内容:基本理论的相关研究、ENSO相关的诊断与模拟研究、两类ENSO相关研究、ENSO触发机制相关研究、ENSO与其他现象的相互作用、外部强迫与大气遥相关、气候变化与ENSO响应;ENSO预测主要包括2个方面的内容:动力-统计ENSO预测方法、ENSO预测系统与应用。最后,还讨论了上述相关方面亟待解决的问题。   相似文献